A Multi-Scale Recurrent Framework for Motion Segmentation with Event Camera

نویسندگان

چکیده

Motion segmentation is a formidable computer vision task, aiming to segment moving targets from dynamic scene. In this paper, we choose introduce an additional modality bolster the robustness. The event camera bio-inspired sensor that accurately detects and captures intensity changes with exceptional temporal resolution range, which optimal choice for motion segmentation. Therefore, present novel framework event-based propose Multi-Scale Recurrent Neural Network (MSRNN) fuse information efficiently. To our best knowledge, it first time multi-scale recurrent architecture implemented in proposed evaluated through experiments conducted on EV-IMO dataset. Our method achieves mean Intersection-over-Union (mIoU) of 82.0%, sets new state-of-the-art further validate approach arduous real-world scenarios, Event Challenging dataset, consisting 350 images corresponding events, outperforms other methods by 1.5% (IoU).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Inlier Estimation for Moving Camera Motion Segmentation

In moving camera videos, motion segmentation is often performed on the optical flow. However, there exist two challenges: 1) Camera motions lead to three primary flows in optical flow: translation, rotation, and radial flow. They are not all solved in existing frameworks under Cartesian coordinate system; 2) A moving camera introduces 3D motion, the depth discontinuities cause the motion discon...

متن کامل

Combinative Multi-scale Level Set Framework for Echocardiographic Image Segmentation

In the automatic segmentation of echocardiographic images, a priori shape knowledge has been used to compensate for poor features in ultrasound images. This shape knowledge is often learned via an off-line training process, which requires tedious human effort and is highly expertise-dependent. More importantly, a learned shape template can only be used to segment a specific class of images with...

متن کامل

A General Inlier Estimation for Moving Camera Motion Segmentation

In moving camera videos, motion segmentation is often achieved by determining the motion coherence of each moving object. However, it is a nontrivial task on optical flow due to two problems: 1) Optical flow of the camera motions in 3D world consists of three primary 2D motion flows: translation, rotation, and radial flow. Their coherence analysis is done by a variety of models, and further req...

متن کامل

A Saccade Based Framework for Real-Time Motion Segmentation Using Event Based Vision Sensors

Motion segmentation is a critical pre-processing step for autonomous robotic systems to facilitate tracking of moving objects in cluttered environments. Event based sensors are low power analog devices that represent a scene by means of asynchronous information updates of only the dynamic details at high temporal resolution and, hence, require significantly less calculations. However, motion se...

متن کامل

Layered Motion Segmentation with a Competitive Recurrent Network

Using local motion information data such as that obtained from optical flow, we present a network for a multilayered segmentation into motion regions that are governed by affine motion patterns. Using an energy-based competitive multilayer architecture based on non-negative activations and multiplicative update rules, we show how the network can perform segmentation tasks that require a combina...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3299597